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The Claims 

This listing of the claims replaces all prior versions of claims in the application. 
Claims 1-53 have been canceled and claims 54-102 have been newly added. 

1-53 (Canceled). 

54. (New) A system that monitors reaction to a media scene, comprising: 
a scene retriever that retrieves a scene from a media store; 

a viewer that displays the scene; and 

a feedback receiver that monitors passive feedback in response to the scene 
displayed by the viewer, the passive feedback is at least one of mood, emotional reaction, 
or facial expressions. 

55. (New) The system of claim 54, the viewer is an active or intelligent device that 
performs a manipulation of the scene prior to display. 

56. (New) The system of claim 55, the manipulation is at least one of cropping the 
scene, rotating the scene, increasing the play speed, decreasing the play speed, color 
correction, digital data reconstruction, decompression, color conversions, or voice 
translation. 

57. (New) The system of claim 54, the feedback receiver further receives active 
feedback associated with the scene displayed by the viewer, the active feedback is at least 
one of a touch input, a typed input, a mouse input, or a voice input. 



2 



PATENT 



MS188917.01/MSFTP304US 



58. (New) The system of claim 57, the active feedback comprises at least one of, a 
command to skip ahead in the playlist, a command to skip back in the playlist, a 
command to generate a new playlist, a command to find scenes similar to the current 
scene, or a command to play a longer scene related to the current scene. 

59. (New) The system of claim 54, the scene retriever further retrieves from the 
media store annotating metadata associated with the scene. 

60. (New) The system of claim 59, the scene retriever retrieves the scene based at 
least in part on a value stored in the associated annotating metadata. 

61. (New) The system of claim 59, further comprising at least one of the following: 

a metadata analyzer that analyzes the annotating metadata in connection with at 
least one of the passive feedback or active feedback in order to identify a relationship; 

a playlist generator that evaluates the relationship and that further produces a 
playlist of related scenes; or 

a playlist updater that updates the playlist based at least in part on at least one of 
the passive feedback, the active feedback, additional passive feedback, or additional 
active feedback. 

62. (New) The system of claim 6 1 , the playlist generator populates the playlist with 
related scenes based at least in part on a value stored in the annotating metadata for each 
respective scene. 

63. (New) The system of claim 61, the playlist updater updates the playlist based on 
at least one of, a usage data, a feedback command, or a time stamp. 
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64. (New) The system of claim 61 , the metadata analyzer computes a similarity value 
for the relationship. 

65. (New) The system of claim 64, the playlist generator produces the playlist of 
related scenes based at least in part on the similarity value. 

66. (New) The system of claim 54, further comprising at least one of the following: 
a scene selector that scans a digitized media and selects a scene in the digitized 

media; 

a metadata generator that produces metadata associated with the selected scene 
and relates the metadata to the selected scene; or 

an organizer that places the selected scene and the metadata in a media store to 
facilitate non-linear viewing of one or more scenes. 

67. (New) The system of claim 66, the scene selector selects a scene based on at least 
one of, face recognition, item recognition, voice recognition, color recognition, mood 
recognition, or theme recognition. 

68. (New) The system of claim 66, the scene selector selects a scene based at least in 
part on the passive feedback or based on an input from a user. 

69. (New) The system of claim 68, the at least one of the face recognition, item 
recognition, voice recognition, color recognition, mood recognition and theme 
recognition is adapted by a machine learning technique based at least in part on the input 
from the user. 
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70. (New) The system of claim 66, the metadata generator produces and stores to the 
metadata at least one of a date, a time, a length, a subject, a mood, a theme, a color, a 
person name, a set of person names, an item name, or a set of item names associated with 
the scene. 

71 . (New) A method for obtaining reactions associated with viewing of media, 
comprising: 

accessing a scene stored in a media store; 

presenting the scene to a user; and 

recording passive feedback from the user as the scene is presented, the passive 
feedback comprising at least one of an inferred mood of the user, an inferred emotional 
reaction by the user, or facial expressions of the user; 

72. (New) The method of claim 71, further comprising accessing metadata associated 
with the scene from the media store. 

73. (New) The method of claim 72, further comprising receiving active feedback 
from the user as the scene is presented. 

74. (New) The method of claim 73, the act of receiving active feedback further 
comprises receiving at least one of a touch input, a typed input, a mouse input, or a voice 
input. 
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75. (New) The method of claim 73, further comprising at least one of the following 
acts: 

analyzing the metadata associated with the presented scene; 

analyzing at least one of the passive feedback or active feedback; 

evaluating a relationship between the metadata and either one of the passive 
feedback or the active feedback; or 

generating a playlist of stored scenes based upon the relationship. 

76. (New) The method of claim 75, the act of generating a playlist comprises at least 
one of selecting a scene based on the presence of a face in the scene, selecting a scene 
based on the absence of a face in the scene, selecting a scene based on the presence of an 
item in the scene, selecting a scene based on the absence of an item in the scene, selecting 
a scene based on a voice in the scene, selecting a scene based on the absence of a voice in 
the scene, selecting a scene based on a mood of the scene and selecting a scene based on 
the theme of the scene. 

77. (New) The method of claim 76, the act of evaluating a relationship further 
comprises computing a similarity score for the relationship based upon the metadata that 
comprises information concerning at least one of a present face, a present item, a present 
voice, a present mood, or a present theme. 

78. (New) The method of claim 76, the act of generating a playlist further comprises 
placing a scene identifier in the playlist. 

79. (New) The method of claim 75, the act of generating a playlist further comprises 
creating a playlist of disparate scenes based at least one of the passive feedback or the 
active feedback. 
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80. (New) The method of claim 75, further comprising updating the playlist based 
upon at least one of the passive feedback, the active feedback, additional passive 
feedback, or additional active feedback. 

8 1 . (New) The method of claim 80, the act of updating the playlist comprises at least 
one of adding a scene to the playlist or removing a scene from the playlist. 

82. (New) The method of claim 75, further comprising navigating the playlist based 
upon at least one of the passive feedback, the active feedback, additional passive 
feedback, or additional active feedback. 

83. (New) The method of claim 82, the act of navigating the playlist comprises at 
least one of moving forward in the playlist, moving backward in the playlist, or 
displaying a media item related to the scene. 

84. (New) The method of claim 75, further comprising navigating the scene based 
upon at least one of the passive feedback, the active feedback, additional passive 
feedback, or additional active feedback. 

85. (New) The method of claim 84, the act of navigating the scene comprises at least 
one of moving forward in the scene, moving backward in the scene, changing the rate of 
scene traversal, pausing the scene, or displaying a media item included in the scene. 
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86. (New) A method for facilitating non-linear viewing of media, comprising: 

receiving passive feedback related to a viewed media scene, the passive feedback 
relates to an inference associated with at least one of a mood, an emotional reaction, or a 
facial expression during presentation of the viewed media scene; 

selecting related scenes by analyzing a metadata associated with the viewed scene 
if the passive feedback is determined or inferred to desire related scenes; 

generating a new playlist of media scenes if the passive feedback is determined or 
inferred to desire a new playlist; and 

navigating a playlist by selectively skipping forward or backward in the playlist if 
the passive feedback is determined or inferred to desire navigation. 

87. (New) A system for annotating video media, comprising: 

a media database comprising a playlist and one or more video segments, where 
the video segments are associated with an annotating metadata; and 

an annotating tool that creates the annotating metadata and that associates the 
annotating metadata with the video segments based upon passive feedback, the passive 
feedback includes at least one of a mood, an emotional reaction, or a facial expression 
obtained while displaying one or more video segments. 

88. (New) The system of claim 87, the annotating metadata comprises at least one of, 
a date identifier, a time identifier, a videographer identifier, a face identifier, an item 
identifier, a voice identifier, a mood identifier and a theme identifier. 



89. (New) The system of claim 87, the annotating tool generates the annotating 
metadata in response to a user input. 
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90. (New) The system of claim 87, the annotating tool automatically generates the 
annotating metadata based at least in part on a face recognition, an item recognition data, 
a voice recognition data, mood data or theme data. 

91 . (New) The system of claim 90, the annotating tool is adapted based on a machine 
learning technique based at least in part on a user input concerning the annotating 
metadata generated by the annotating tool. 

92. (New) A method that facilitates non-linear viewing of media, comprising: 
selecting a scene from a set of digitized media; 

annotating the selected scene with metadata based upon passive feedback 
obtained during presentation of one or more scenes, the passive feedback is at least one of 
a mood, an emotional response, or a facial expression; and 

storing the annotated scene to facilitate non-linear retrieval of the annotated scene. 

93. (New) The method of claim 92, the act of selecting the scene from the set of 
digitized media further comprises: 

manually scanning one or more scenes from the set of digitized media; and 

manually selecting the scene. 

94. (New) The method of claim 92, the act of selecting the scene from the set of 
digitized media comprises: 

automatically scanning one or more scenes from the set of digitized media; and 

automatically selecting the scene based on at least one of face recognition, item 
recognition, voice recognition, color recognition, mood recognition and theme 
recognition. 
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95. (New) The method of claim 92, the act of annotating the selected scene with 
metadata further comprises associating at least one of a date, a time, a length, a subject, a 
mood, a theme, a color, a person, a set of people, an item or a set of items with the 
selected scene. 

96. (New) The method of claim 92, further comprising storing the annotated scene to 
at least one of a database or a datacube for facilitating non-linear retrieval of the 
annotated scene. 

97. (New) A system for delivering media content, the system comprising: 

a media data store comprising one or more metadata annotated, displayable items; 
a presenter that presents a selected first displayable item from the media data 

store; 

a selector that selects a second displayable item from the media data store based, 
at least in part, on a relationship between a first metadata associated with the first 
displayed item and a second metadata associated with the second displayable item; and 

an evaluator that determines and evaluates the relationship based upon passive 
feedback acquired from display of one or more displayable items, the passive feedback 
comprises at least one of a mood during display, a facial expression during display, or an 
emotional response during display. 

98. (New) The system of claim 97, the media data store is at least one of a database, a 
data cube, a list, an array, a tree, or a file. 

99. (New) The system of claim 97, the presenter is at least one of an intelligent 
display and a non-intelligent display. 
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100. (New) The system of claim 97, the presenter is at least one of an active display 
and a passive display. 

101 . (New) The system of claim 97, the selector selects a second displayable item 
based at least in part in response to a user response to the first displayable item. 

102. (New) The system of claim 101, the user response is at least one of, a spoken 
word, a keystroke, a mouse click, or a facial expression. 
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